A randomized ELM speedup algorithm

نویسندگان

  • Chang-qian Men
  • Wen-jian Wang
چکیده

Extreme learning machine (ELM) as an emergent technology has shown its good performance in classification applications. However, ELM algorithm needs to find the inversion of matrix in nature, which will limit its application on many occasions. This paper proposes an ELM speedup algorithm based on the analysis of ELM algorithm. By applying randomized approximation method, the proposed algorithm can approximate the key matrix (For example, the kernel matrix in the kernel-based ELM) with a low-rank matrix. By doing so, the complexity of the inversion can be reduced from Oðn3Þ to OðknþkÞ (n is the size of the data set, and k is the numerical rank of the approximated matrix). On the premise of not decreasing the accuracy too much, the training time can be cut down substantially, which has important significance in practical application of machine learning algorithms. The experimental results on benchmark data sets demonstrate the effectiveness of the proposed algorithm. & 2015 Elsevier B.V. All rights reserved.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

On the kernel Extreme Learning Machine speedup

In this paper, we describe an approximate method for reducing the time and memory complexities of the kernel Extreme Learning Machine variants. We show that, by adopting a Nyström-based kernel ELM matrix approximation, we can define an ELM space exploiting properties of the kernel ELM space that can be subsequently used to apply several optimization schemes proposed in the literature for ELM ne...

متن کامل

Parallel extreme learning machine for regression based on MapReduce

Regression is one of the most basic problems in data mining. For regression problem, extreme learning machine (ELM) can get better generalization performance at a much faster learning speed. However, the enlarging volume of datasets makes regression by ELM on very large scale datasets a challenging task. Through analyzing the mechanism of ELM algorithm, an efficient parallel ELM for regression ...

متن کامل

Efficient Batch Parallel Online Sequential Extreme Learning Machine Algorithm Based on MapReduce

With the development of technology and the widespread use of machine learning, more and more models need to be trained to mine useful knowledge from large scale data. It has become a challenging problem to train multiple models accurately and efficiently so as to make full use of limited computing resources. As one of ELM variants, online sequential extreme learning machine (OS-ELM) provides a ...

متن کامل

An approach to Improve Particle Swarm Optimization Algorithm Using CUDA

The time consumption in solving computationally heavy problems has always been a concern for computer programmers. Due to simplicity of its implementation, the PSO (Particle Swarm Optimization) is a suitable meta-heuristic algorithm for solving computationally heavy problems. However, despite the simplicity, the algorithm is inefficient for solving real computationally heavy problems but the pr...

متن کامل

عیب‌یابی سازه‌ها با استفاده از شاخص تابع پاسخ فرکانسی و مدل جایگزین مبتنی بر الگوریتم ماشین یادگیری حداکثر بهینه شده

Utilizing surrogate models based on artificial intelligence methods for detecting structural damages has attracted the attention of many researchers in recent decades. In this study, a new kernel based on Littlewood-Paley Wavelet (LPW) is proposed for Extreme Learning Machine (ELM) algorithm to improve the accuracy of detecting multiple damages in structural systems.  ELM is used as metamo...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Neurocomputing

دوره 159  شماره 

صفحات  -

تاریخ انتشار 2015